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i. Introduction 


A possible objection to the use of L'HMLE or CLASSY In conjunction with 
AMOEBA Is that both these algorithms Ignore the association of pixels In 
fields. Indeed Af-IOEBA Is based on the explicit assumption that pixels In 
the same field represent the same real class (H, while the assumptions 
underlying the maximum likelihood algorithms Imply that the classification 
of a pixel Is Independent of the classification of other pixels. In this 
report a statistical model based on normal mixtures Is proposed whicn takes 
Into account the organization of LANDSAT agricultural data Into fields 
which are homogeneous as to crop type. Likelihood equations for the 
parameters of the model are derived which may be solved Iteratively as In 
UHHLF. 


2. The Mode l 

We assume that the data elements (pixel data vectors) are real n-vectors 

each from one of the statistical populations 11,, .... n with n-varlate 

1 m 

density functions p(x|n^), t » 1, .... m. We assume that the data Is 

organized into sets (fields) Fj, .... Fp, where Fj has Nj data elements 

which have been previously ordered In some arbitrary fashion so that the 

^11 

data elements in F. form a nN .-dimensional vector denoted by * . 

J J J * 


Define random variables m)|j = l, 

and only if Is from II^^. We assume that 


^jMj 

. . . , p; k=l; .... Nj } by if 

all the observations from F. are 

«3 



2 . 


from the same class, sc that we may write 6j|^ ■ 0j for all j * 1, 

.... p; k, .... Nj. Finally, we assume that (Afj, 0j), ..., (Jirp,0p) are 
independent, that the 0j's are identically distributed, that 


m 


dj ■ Prob [0, » tl > 0 and that E a. » 1. Under the stated assumptions, 

p m 

joint density of is p(x, , . . . , x ) * II F oi. p (x-), 

1 P 1 P j»l e»l ^ 


where Pj(Xj) * **•» ^jNj^®j * joint density of the elements of 

Fj given that Fj represents class n^. 


Let N « Nj + + Np and for each t let denote the total number 

of the N observations which come from class Ilj^. The following 

preposition shows that with reasonable restrictions on the field sized Nj 
the values of (M^: i ~ 1, ..., ml can be inferred from a knowledge of the 
parameters Thus, acreage estimates of the classes can be derived 

from estimates of the parameters a^. 


Proposition 1: (a) E(M^) » a^N 

(b) -|j— ♦ in probability as p * •» if and only if 

1 P 2 

lim -4- E . 0. 

p„.. j = l J 

/ C, 

(c) If j: S / 0 f^en -jj — ► It almost surely. 

j=l / r N V 

P N. 

Proof: (a) Write M = E E-^ X, (O^l) 

^ j=l k=l - 

P 
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1 r « £ 

0 r * I 


Then E(M ) « Y. N, E(x,(0j) • T. N. a. « Na.. 
t j.l j ^ J j-1 J ^ 


(b) Since 


— -IE I is bcjnded, it converges to zero 


in probability iff var -j;p ♦ 0 as p Since the terms 


independent. 


1 p 2 1 p 2 

■ — y ^ N. var (Xj(0.)) » — »r i.' N. a.{\~ci.) 

jxi J J j*l J ^ ^ 


The conclusion follows. 


(c) The assertion follows immediately from Kolmogorov's version of the 


strong law of large numbers [31. 


3. tiaximum Likelihood Estimation of the Pcrameters 

In this section we suppose that the class conditional densities 
p(x|llj^) of the data elements are n-variate normal N(x:P|j,j:j) and that 
k?l, Nj} are class conditionally independent; i.e., that 

Pj(Xj) = li N(Xj^i I.J. Jj). 


for j = l, p. In this case the joint density of A'j A'p, 
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P m 

p(x., X ) ■ n £ a. II N(x.,; Uj* ^«)« 

* P j-1 * k«l ^ ^ 

Is parametrized by {(a^, pj^, m) where s; 0, E « 1 , 

and E^ is a real n x n positive definite symmetric matrix. Whenever 

a density is evaluated using estimates of its parameters, we denote it, 

e.g., by p(xj, ..., x^). By a maximum likelihood estimate (MLE) of the 

parameters ((aj^, p^, E^^)} we mean an element {(S|j, p,^, ..., m} 

of the parameter set which locally maximizes p(Afj, ..., Jf^). By arguments 

similar to those used in F21, the following necessary conditions for a MLE 

are derived. 


P P,(Af)) 

J'l P()fj) 


with equality 
when Ujj > 0 


NjP,(*j) 




NiP,(J(,) 




Po(jfi) 

nt V \ ^ 




N,P,(;r.) 


" j = l p(ATj) k»l /j«l p(^.) 

1 ^ 

In equation (2) X- = -n- E'' X., is the mean of the jth field observations. 

J k=l 

By multiplying (1) by a. we obtain 


" j>l P(*j) 
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which, together with (2) and (3) suggests an Iterative procedure for 
solution of the likelihood equations (2) - (4) analogous to that used 
in UHMLE 12]. However, the likelihood equations can be considerably 
simplified by observing that the sequence (Fj, Sj), ..., (Jp, Sp), is a 
sufficient statistic for the model, where Sj is the sample scatter matrix 
of the jth field: 


- - T 

s. * z - X.) {x^^ - X.)'. 
J 




Equation (3) may be rewritten 


5) 


A 

J , 


P 

}; 

j=l 




Sj / ^ 

^ j j=l 




p'*j> 


P 

): 

j=i 







5(*j) 


The sufficiency of (Tj. 


MitL , ^.t’ 

pUj) c(*j. Sj) 


where q. (x., S-) is the estimated joint density of X- and S- given that F 
K* J J ^ J J 

represents class t and q(x., Sj = T. a.q (x., S-). The joint density 

J J n*i J 
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Sj) may be expressed as 

Sj) - (?j; W^(Sj; Nj-1 , Z^) 

where (;ifj; Uj^, Z^) is the n-varlate normal density of Jtj and 

A j 

W„(S.; Nj Zj) is the Wishart density of Si with N.-l degrees of freedom [31, 
Thus the likelihood equations may be written as 


6 ) 


7 ) 


H) 


A 

a. 


A 

Ut 


1 


p 


5(7j. s.) 


p 

>; 

j=l 


3(?j. Sj) J 


j=i 


SCij. Sj) 


/ 

/ 


P N.q (;r.. S.) 
J' , J. / iL — 

j = l q(Jj, Sj) 


J=1 (i(Fj. Sj) 


0 

+ Z 

j = l 


N.q«(^i. S.) _ _ ^ T / P 

J I J ^ (X,-C,)(.t,-S,)V T. 

q(7j. Sj) J « J ‘ / J.l 


3(7j. Sj) 


Equations (6) - (8) are to be used as the basis of the iteration procedure. 
Indeed when each Nj = 1 they reduce to the likelihood equations employed 
in l.HMLE. 

4. C oncluding R emarks . 

The (|uestions of the existence of a consistent MIF as p * ••• and the 
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local convergence of the Iterative procedure will be addressed in a future 
report. We remark that the standard consistency results of Cramer, Chanda, 
and Wald (see I 21 for references) are not directly applicable since the 
(7., SJ are not identically distributed. Numerical results will also 
be reported at a later date. 
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